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AMENDMENTS TO THE CLAIMS 

1 . (Currently Amended) A method for generating a wide image video sequence of 
a scene being recorded using a device having at least two video cameras substantially co- 
located in a predetermined relationship to each other such that there will be an overlap between 
images from the respective cameras, said method comprising the steps of: 

fti forming a synthetic imago from imogcs of the respective cameras by (i) 

idcntifiing corresponding parts in overlapping parts of the images, (ii) determining the 
relation bct w ccn the respective coordinates for the pixels in the individual cameras and in 
the synthetic image, and (iii) calculating calibration parameters from said relation, said 
calculated calibration parameters being unique for the at least two camera s and their 
current location as related to the object being recorded; 

a. identifying corresponding lines in overlapping parts of the images from the 
respective cameras; 

b. calculating a projective transform for pixels of the images from at least one 
of said cameras based on a relation between said corresponding lines; 

c. br synchronously recording video sequences using each of said at least two video 
cameras; and 

d. €1 generating a wide image video sequence by combining said synchronously 
recorded video sequences using said projective transform calculated calibration parameters, 

wherein the step of calculating calibration parameter s comprises the step of 
calculating a projective transform by comparing s patial characteristics of said 
corresponding parts with each other, and wherein the step of generating the wide image 
video sequence is performed using said projective transform . 

2. (Previously Presented) A method according to claim 1 , wherein the 
synchronously recorded video sequences sue stored in a memory storage area. 



3. (Canceled) 
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4. (Previously Presented) A method according to claim 3, wherein the wide image 
video sequence is transmitted live. 

5. (Previously Presented) A method according to claim 3, wherein the wide image 
video sequence is stored on a memory storage area. 

6. (Currently Amended) A method according to claim 1 , wherein calculating the 
calibration comprises further comprising the following steps: 

a. starting a calibration process; 

b. synchronizing the sequences from each of the at least two cameras; 

c. computing inter-image projective transformations; 

d. using the transformations to refer each image to a common reference frame; 

e. selecting a real or virtual reference camera such that certain lines on the pitch or 
stadium are substantially horizontal and substantially parallel in the wide image; 

f. selecting a rectangular region of interest within the wide image; and 

g. storing the computed values resulting from the calibration process to be used as 
the calibration parameters. 

7. (Previously Presented) A method according to claim 6 further comprising the 
step of determining lens distortion parameters for each camera, and correcting radial distortion in 
each image. 

8. (Previously Presented) A method according to claim 6 further comprising the 
step of selecting non-linear distortion parameters to reduce perspective distortion of the wide 
image. 

9. (Canceled) 



LEGAL02/31796969vl 



3 of 19 



Appl.No.: 10/564,286 

Amdt. dated April 13, 2010 

Reply to Office Action of January 14, 2010 

10. (Currently Amended) A method according to claim 1 in which step c [[b]] is 
performed automatically by an algorithm for identification of corresponding features in 
concurrent video images and the coordinates for the corresponding features are input via a 
computer means. 

1 1 . (Currently Amended) A method according to claim 1 further comprising 
performing the following steps until completing the generation of the wide image video 
sequence: 

a. applying tbe calculated calibration parameters; 

b. until the end of the sequence is reached, for each pixel in the wide image, 
computing and storing parameters describing (1) which pixels from which images contribute to 
the respective pixels in the wide image and (2) how much each of the respective pixels 
contributes to the wide image; 

c. retrieving one new image fi-om each camera; 

d. selectively updating the parameters needed to transform intensities in one or more 
of the cameras to eliminate visible seams; 

e. selectively adjusting intensities in the images from one or more of the cameras; 

and 

f creating the current seamless, wide image from the current images firom each 
camera; 

g. outputting the wide image to a display or to a memory storage area, 

12. (Previously Presented) A method according to claim 1 1 , wherein the new images 
from each camera are read from live sources, each such source comprising a video camera. 

1 3 . (Previously Presented) A method according to claim 1 1 wherein the new images 
from each video camera are read from a memory storage area. 
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14. (Currently Amended) A device having at least two video cameras substantially 
co-located and arranged in a predetermined relationship to each other such that there will be an 
overlap between images from the respective cameras, a processor, at least one memory storage 
area, wherein the processor is configured to: 

«j form a synthetic image from images of the respective cameras by (i) identifying 

corresponding parts in overlapping parts of the images, (11) determining the relation 
between the respective coordinates for the pixels in the individual cameras and in the 
synthetic imago, and (ill) calculating calibration parameters from said relation by 
calculating a projective transform by comparing spatiol characteristics of said 
corresponding parts with each other, said calculated calibration parameters being unique 
for the at least two cameras and their current location as related to the object being 

a. identify corresponding lines in overlapping parts of the images from the 
respective cameras; 

b. calculate a projective transform for pixels of the images from at least one of 
said cameras based on a relation between said corresponding lines; 

c. br synchronously record video sequences using each of said at least two video 

cameras; and 

d. generate a wide image video sequence of a scene being recorded by combining 
said synchronously recorded video sequences using said calculated calibration parameters 
and using said projective transform. 

15. (Previously Presented) The device of claim 14, wherein the synchronously 
recorded video sequences are stored in a memory storage area. 

16. (Canceled) 

17. (Previously Presented) The device of claim 14, wherein to calculate calibration 
parameters, the processor is further configured to: 

a. start a calibration process; 
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b. synchronize the sequences fi-om each of the at least two cameras; 

c. compute inter-image projective transformations; 

d. use the transformations to refer each image to a common reference frame; 

e. select a real or virtual reference camera such that certain lines on the pitch or 
stadium are substantially horizontal and substantially parallel in the wide image; 

f. select a rectangular region of interest within the wide image; and 

g. store the computed values resulting from the calibration process to be used as the 
calibration parameters. 

1 8. (Currently Amended) The device of claim 17 [[14]], wherein to calculate the 
calibration parameters, the processor is fiirther configured to determine lens distortion 
parameters for each camera, and correct radial distortion in each image produced. 

19. (Currently Amended) The device of claim 17 [[14]], wherein to calculate the 
calibration parameters, the processor is fiuther configured to select non-linear distortion 
parameters to reduce perspective distortion of the wide image. 

20. (Canceled) 

2 1 . (Currently Amended) The device of claim 14, wherein step c [[b]] is performed 
automatically by an algorithm for identification of corresponding features in concurrent video 
images and the coordinates for these corresponding features are input to a computer storage area. 

22. (Currently Amended) The device of claim 14, wherein the processor is fiirther 
configured to: 

a. apply the calculated calibration parameters; 

b. until the end of the sequence is reached, for each pixel in the wide image, 
compute and store parameters describing (1) which pixels from which images contribute to the 
respective pixels in the wide image and (2) how much each of the respective pixels contributes to 
the wide image; 
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c. retrieve one new image from each camera; 

d. selectively update the parameters needed to transform intensities in one or more 
of the cameras to eliminate visible seams; 

e. selectively adjust intensities in the images from one or more of the cameras; and 
f create the current seamless, wide image from the current images from each 

camera; 

g. output the wide image to a display or to a memory storage area. 

23. (Previously Presented) The device of claim 22, wherein the new images from 
each camera are read from live sources, each such source comprising a video camera. 

24. (Previously Presented) The device of claim 22, wherein the new images from 
each video camera are read from a memory storage area. 

25. (Currently Amended) A computer-readable medium having computer-readable 
program code portions stored therein, the computer-readable program code portions comprising 
executable portions that cause a device having at least two video cameras substantially co- 
located in a predetermined relationship to each other such that there will be an overlap between 
images from the respective cameras to: 

th form a synthetic imago from images of the respective cameras by (i) 

identifying corresponding parts in overlapping parts of the images, (ii) determining the 
relation between the respective coordinates for the pixels in the individual cameras and in 
the synthetic image, and (iii) calculating calibration parameters from s aid relation by 
calculating a projective transform by comparing spatial charact e ristics of said 
corresponding parts with each other, said calculated calibration parameters being unique 
for the at least two cameras and their current location a s related to the object being 

g. identify corresponding lines in overlapping parts of the images from the 
respective cameras; 
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b. calculate a projective transform for pixels of the images from at least one of 
said cameras based on a relation between said corresponding lines; 

c. fer synchronously record video sequences using each of said at least two video 

cameras; and 

d. €t generate a wide image video sequence of a scene being recorded by combining 
said synchronously recorded video sequences using said calculated calibration parameters 
and using said projective transform. 

26. (Previously Presented) The computer-readable medium of claim 25, wherein the 
synchronously recorded video sequences are stored in a memory storage area. 

27. (Canceled) 

28. (Currently Amended) The computer-readable medium of claim 25, wherein to 
calculate ihe calibration parameters, the computer-readable medium further comprises 
executable portions that cause the device to: 

a. start a calibration process; 

b. synchronize the sequences from each of the at least two cameras; 

c. compute inter-image projective transformations; 

d. use the transformations to refer each image to a common reference frame; 

e. select a real or virtual reference camera such that certain lines on the pitch or 
stadium are substantially horizontal and substantially parallel in the wide image; 

f. select a rectangular region of interest within the wide image; and 

g. store the computed values resulting from the calibration process to be used as the 
calibration parameters. 

29. (Previously Presented) The computer-readable medium of claim 28, further 
comprising executable portions that cause the device to determine lens distortion parameters for 
each camera, and correct radial distortion in each image produced. 



LEGAL02/31796969vl 



8 of 19 



Appl.No.: 10/564,286 

Amdt. dated April 13, 2010 

Reply to Office Action of January 14, 2010 

30. (Previously Presented) The computer-readable medium of claim 28, further 
comprising executable portions that cause the device to select non-linear distortion parameters to 
reduce perspective distortion of the wide image. 

31. (Canceled) 

32. (Currently Amended) The computer-readable medium of claim 28, wherein step 
c [[b]] is performed automatically by an algorithm for identification of corresponding features in 
concurrent video images and the coordinates for the corresponding features are input to a 
computer means. 

33. (Currently Amended) The computer-readable medium of claim 28, further 
comprising executable portions that causes eause the device to: 

a. apply the calculated calibration parameters; 

b. until the end of the sequence is reached, for each pixel in the wide image, 
compute and store parameters describing (1) which pixels from which images contribute to the 
respective pixels in the wide image and (2) how much each of the respective pixels contributes to 
the wide image; 

c. retrieve one new image from each camera; 

d. selectively update the parameters needed to transform intensities in one or more 
of the cameras to eliminate visible seams; 

e. selectively adjust intensities in the images from one or more of the cameras; and 

f. create the current seamless, wide image from the current images fi-om each 

camera; 

g. output the wide image to a display or to a memory storage area. 

34. (Previously Presented) The computer-readable medium of claim 28, wherein the 
new images fi-om each camera are read fi-om live sources, each such source comprising a video 
camera. 
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35. (Previously Presented) The computer-readable medium of claim 28, wherein the 
new images from each video camera are read fi-om a memory storage area. 

36. (Currently Amended) A video recording apparatus having at least two video 
cameras substantially co-located in a predetermined relationship to each other such that there 
will be an overlap between images fi-om the respective cameras, the video recording apparatus 
comprising: 

a microprocessor (130); 

a memory storage area (120) storing a program for: 

fti forming a synthetic image from images of the respective cameras by 

(i) identifying corresponding parts in overlapping parts of the images, (ii) determining the 
relation bct t vccn the respective coordinates for the pixel s in the individual cameras and in 
the synthetic image, and (iii) calculating calibration parameters from said relation by 
calculating a projective transform by comparing spatial characteristic s of s aid 
corresponding parts with each other, said calculated calibration parameters being unique 
for the at least two cameras end their current location as related to the object being 

a. indentifying corresponding lines in overlapping parts of the images 
from the respective cameras, 

b. calculating a projective transform for pixels of the images from at 
least one of said cameras based on a relation between corresponding lines. 

c. h? synchronously recording video sequences using each of said at least two 
video cameras, and 

d. Cr generating a wide image video sequence of a scene being recorded by 
combining said synchronously recorded video sequences using said calculated calibration 
parameters and using said projective transform, 

a read and write memory storage area (140) for storing data relating to recorded video 
sequences from the at least two video cameras; 

an input component (300) for receiving input of parameters, and input of recorded video 
sequences; and 
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an output component (300) for outputting of a wide image video sequence. 

37. (New) A method according to claim 1 , wherein said corresponding lines depict a 
line naturally occurring in the scene being recorded. 

38. (New) A method according to claim 37, wherein the scene being recorded is a 
sports field, and wherein said line naturally occurring in the scene being recorded is a sports field 
mark line. 

39. (New) A method according to claim 1 , wherein the step of identifying said 
corresponding lines is performed manually. 

40. (New) A method according to claim 1 , wherein the step of identifying said 
corresponding lines is performed automatically. 

41 . (New) The device of claim 14, wherein said corresponding lines depict a line 
naturally occurring in the scene being recorded. 

42. (New) The device of claim 14, wherein the scene being recorded is a sports field, 
and wherein said projective transform refers each image to a common reference fi-ame, and the 
processor is fiirther configured to select said reference fi-ame such that certain lines on the sports 
field become essentially horizontal and parallel in the wide image video sequence. 

43. (New) The computer-readable medium of claim 25, wherein said corresponding 
lines depict a line naturally occurring in the scene being recorded. 

44. (New) The computer-readable medium of claim 25, wherein the scene being 
recorded is a sports field, and wherein said projective transform refers each image to a common 
reference frame, and the computer-readable mediimi fiirther comprises executable portions that 
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cause the device to select said reference frame such that certain lines on the sports field become 
essentially horizontal and parallel in the wide image video sequence. 

45. (New) The apparatus of claim 36, wherein said corresponding lines depict a line 
naturally occurring in the scene being recorded, 

46. (New) The apparatus of claim 36, wherein the scene being recorded is a sports 
field, and wherein said projective transform refers each image to a conmion reference fi-ame, and 
the program is further for selecting said reference fi-ame such that certain lines on the sports field 
become essentially horizontal and parallel in the wide image video sequence. 
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